This setting is helpful for email clients other than Outlook, e.g., emails from the CRM system. The new/reply signature is visible at the recipient's end. It's not visible as you compose your email. The email is rerouted through one of our Azure servers, where we apply the default/reply signature and return it to your tenant. Your tenant sends the email to the recipient.